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by  separable  functions  of  the  original  random  variables  or  linear  transformations  of  them. 
The  resulting  bound  then  involves  summing  simple  integrals.  These  integrals  may  them¬ 
selves  be  difficult  to  compute  or  may  require  more  information  about  the  random  variables 
than  is  available.  In  this  paper,  we  show  that  a  special  class  of  functions  has  an  easily 
computable  bound  that  achieves  the  best  upper  bound  when  only  first  and  second  moment 
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1.  Introduction.  The  recourse  problem  in  stochastic  programming  is  to  find  the 
expected  value  of  minimizing  the  cost  of  meeting  some  set  of  constraints  that  may  depend 
on  a  random  variable,  w.  In  this  analysis,  we  suppose  that  the  resulting  function  is  convex. 
In  general,  we  seek  to  bound  the  integral  of  this  or  any  convex  function  which  is  too 
expensive  for  numerical  integration  or,  for  which,  only  limited  distributional  information 
is  known.  Thus,  many  problems  in  applied  mathematics,  such  as  calculating  the  average 
load  on  a  structure,  the  present  value  of  a  stock  option,  or  the  expected  performance  of  a 
computer  system,  fit  this  framework. 

The  general  problem  is  to  find: 

E,(*)  =  E{/(*(«))}  =  J  f(*(u))P(du),  (11) 

where  x  is  a  random  vector  mapping  the  probability  space,  (Q,  A,  P),  onto  (SR^ ,  BN ,  F),  F 
is  the  distribution  function  of  x,  and  x  €  X  C  ■  The  expectation  functional,  E j{x),  can 
also  be  written  as  a  Lebesgue-Stieltjes  integral  with  respect  to  F: 

E /(*)  =  f  f(x)dF(x).  (1.2) 

J*" 

Difficulties  arise  in  evaluating  E /  (*)  when  either  the  function  /  is  difficult  to  evaluate  or 
the  distribution  function  F  is  not  known  exactly.  In  stochastic  programming,  the  function 
/  is  the  optimal  value  of  a  recourse  action  which  depends  on  x(ui).  This  function  is  convex 
for  the  following  recourse  problem  in  which  the  random  vector  appears  as  a  linear  term  in 
the  constraints.  In  this  case, 

/(r(w))  =  ;'e  '?(y(w))|y(y(w))  <  *(w)  a.  s.  },  (1.3) 

»(«- 

where  q  :  3im  — *  3R  and  g  :  8"*  —  .c1*  are  convex.  In  general,  each  evaluation  of  / 
requires  the  solution  of  a  mathematical  program.  Although  many  approximation  formulas 
for  integrals  (1.2)  have  been  given  (see  Davis  and  Rabinowitz  [8]),  the  expense  in  these 
computations  and  the  possible  high  values  of  N  make  them  inefficient. 

In  this  paper,  we  concentrate  on  approximations  that  first  bound  /  with  a  separable 
function  and  then  compute  integrals  in  each  variable  separately.  We  suppose  that  only  first, 
second  moment  and  some  range  information  is  available  and  show  that  a  tight  bound  on 
the  expectation  of  a  large  class  of  convex  functions  with  known  first  and  second  moments 
can  be  obtained  in  a  single  linesearch.  This  result  extends  results  for  linear  subproblems 


(1.3)  and  contrasts  with  previous  methods  that  either  require  generalized  programming 
([3,6,14])  or  obtain  a  looser  bound  through  linear  approximation  ([5]). 

Section  2  provides  background  on  previous  approaches  to  bounding  expectations.  The 
generalized  moment  problem  interpretation  is  given  in  Section  3.  Section  4  presents  the 
separable  approximation  used  for  the  bound.  Section  5  presents  basic  results  for  bounds 
on  each  separable  component  and  some  examples  of  the  general  class  of  functions  allowed 
in  this  analysis. 

2.  Background  and  previous  approximations.  Many  of  the  approximation 
schemes  for  stochastic  programs  with  recourse  are  described  in  Birge  and  Wets  [3]  and 
Kali  [24].  For  general  functions  /,  the  basic  procedures  to  approximate  E/(x)  use  some 
form  of  a  discrete  approximation .  for  the  distribution  of  x.  Numerical  integration  proce¬ 
dures  are  often  based  on  the  midpoint  and  the  trapezoidal  approximations.  On  an  interval, 
[a,  6],  the  approximations  are  improved  by  dividing  [a,b]  into  subintervals,  appropriately 
weighting  the  subintervals  and  applying  the  midpoint  and  trapezoidal  approximations  on 
each  subinterval. 

A  more  sophisticated  procedure  is  gauaaian  quadrature  to  find  an  integral  formula  that 
fits  all  polynomials  up  to  some  degree.  As  noted  by  Miller  and  Rice  [33],  this  can  be  used  to 
find  a  discretization  with  K  values  that  matches  the  first  K  + 1  moments  of  the  distribution 
of  x.  To  match  the  first  three  moments  of  the  uniform  distribution  on  [a,b],  for  example, 
gaussian  quadrature  selects  two  points,  (o  +  6)/2  ±  (\/3/6)(6  -  a),  with  equal  probability, 
1/2. 

A  difficulty  with  using  the  gaussian  quadrature  formulas  is  that  they  do  not  generally 
provide  bounds  on  the  expectation.  Restrictions  on  higher-order  derivatives  and  Peano’s 
theorem  [34]  provide  bounds  but  they  require,  at  least,  differentiability  of  /  and  a  density 
function  that  may  not  be  available.  Generalizations  of  the  mid-point  and  trapezoidal 
approximations  do,  however,  obtain  bounds  on  the  expectation  of  a  convex  function.  For 
example,  Jensen’s  inequality  [23]  can  be  interpreted  as  a  generalization  of  the  mid-point 
approximation  that  provides  a  lower  bound  on  the  expected  value  of  convex  /  through: 

/  f(x)dF(z)>f([  xdF(z)),  (2.3) 

where  x  =  fm„  xdF(x)  is  assumed  finite. 
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Madansky,  following  Edmundson,  ([13],  [31])  provided  a  generalization  of  the  trape¬ 
zoidal  approximation,  called  the  Edmundson-Madansky  inequality,  that  gives  an  upper 
bound  on  the  expectation  of  a  convex  function.  For  N  =  1,  the  basic  inequality  is: 


((b-i)f(a)  +  (x  —  a)f(b)) 
(b-a) 


(2.4) 


where  X  =  [a,  6],  The  Edmundson-Madansky  inequality  (2.4)  can  also  be  extended  to 
multiple  dimensions  and  infinite  intervals  (see,  for  example,  [1],  [15],  and  [18]). 

Refinements  of  the  Jensen  and  Edmundson-Madansky  inequalities  are  possible  by 
subdividing  the  interval  (or,  more  generally,  the  region)  into  smaller  pieces  on  wnich  the 
bounds  can  be  reapplied  as  in  the  traditional  mid-point  and  trapezoidal  approximations 
(see  [3],  [17],  [21],  and  [26]).  These  refinements  require  additional  functional  evaluations 
and  conditional  expectations  on  the  subregions.  As  has  been  observed,  the  Jensen  lower 
bound  is  generally  reasonably  accurate  relative  to  the  Edmundson-Madansky  upper  bound 
(e  g.,  [19]),  which  requires  a  number  of  function  evaluations  that  increases  exponentially  in 
the  number  of  random  variables.  The  primary  concern  is  then  in  obtaining  more  accurate 
upper  bounds  without  additional  computational  effort. 


A  bound  for  linear  recourse  problems  that  requires  linear  work  in  the  number  of  the 
random  variables  was  introduced  in  [3]  and  extended  in  [4]  and  [2].  A  similar  bound  also 
appears  for  network  recourse  problems  in  Wallace  [40j.  Related  extensions  to  functions  built 
on  a  simpiicial  decomposition  of  the  function  also  appear  in  Dula  [10]  and  Frauendorfer 
[16]- 

This  paper  builds  on  the  idea  of  introducing  separability  into  the  recourse  function.  It 
extends  this  idea  of  separability  to  the  nonlinear  recourse  problem  in  (1.3)  and  assumes  only 
that  first  and  second  moment  information  is  known  about  each  of  the  random  components. 
This  is  especially  important  when  the  random  components  are  transformations  of  some  set 
of  original  random  variables. 

The  results  here  show  that  bounds  on  each  component  are  easily  computable  in  a  single 
linesearch  for  a  broad  class  of  convex  functions,  if  second  moment  information  is  available. 
We  note  that  these  results  can  also  be  seen  as  extensions  of  Kail’s  result  [25]  in  this  volume 
for  bounding  the  optimal  value  of  the  linear  recourse  problem  with  only  first  and  second 
moment  information.  In  both  analyses,  a  generalized  moment  problem  formulation  leads 
to  the  bound.  This  problem  is  described  in  the  next  section. 
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3.  Generalised  moment  problem.  To  obtain  bounds  that  hold  for  all  distributions 
with  certain  properties,  we  can  find 

Q  €  V  a  set  of  probability  measures  on  ( X,BN )  subject  to 


J  Vi(x)Q(dx)  <<*,-,»=  l,...,s, 

I  i’i(x)Q(dx)  =  or,-, i  =  s  +  1, . . . , M, 

Jx 


(3.1) 


to  maximize  /  f(x)Q(dx), 

Jx 

where  M  is  finite  and  the  v,  are  bounded,  continuous  functions.  A  solution  of  (3.1)  obtains 
an  upper  bound  on  the  expectation  of  /  with  respect  to  any  probability  measure  satisfying 
the  conditions  above.  Problem  3.1  is  a  generalized  moment  problem  ( [29]).  When  the  are 
powers  of  x ,  the  constraints  restrict  the  moments  of  x  with  respect  to  Q.  In  this  context, 
(3.1)  determines  an  upper  bound  when  only  limited  moment  information  on  a  distribution 
is  available. 

Problem  3.1  can  also  be  interpreted  as  an  abstract  linear  program  since  the  objective 
and  constraints  are  linear  functions  of  the  probability  measure.  The  solution  is  then  an 
extreme  point  (see  [37]  for  a  discussion  of  properties)  in  the  infinite  dimensional  space  of 
probability  measures.  The  following  theorem,  proven  in  [27,  Theorem  2.1],  gives  the  explicit 
solution  properties. 


Theorem  3.1.  Suppose  X  is  compact.  Then  the  set  of  feasible  measures  in  (3.1), 
Q,  is  convex  and  compact  (with  respect  to  the  weak’  topology),  and  Q.  is  the  closure  of 
the  convex  hull  of  the  extreme  points  of  Q.  If  f  is  continuous  relative  to  X,  then  an 
optimum  (maximum  or  minimum)  of  fx  f(x)Q(dx)  is  attained  at  an  extreme  point  of  Q. 
The  extremal  measures  of  Q  are  those  measures  that  have  finite  support,  {*j, . . .  ,xi},  with 
L  <  M  +  1,  such  that  the  vectors, 


/  Vt(*l)  \ 

/  vi(xL)  \ 
V7(*l) 

Vm(*  l) 

\  1  ) 

>  *  *  *  » 

\  1  / 

(3.2) 
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are  linearly  independent. 


Kemperman  [28]  showed  that  the  supremum  is  attained  under  more  general  continuity 
assumptions  and  provides  conditions  for  Q  to  be  nonempty.  Dupacova  (formerly  Zadkova) 
[11,  12,  41]  pioneered  the  use  of  the  moment  problem  as  a  bounding  procedure  for  stochastic 
programs  in  her  work  on  a  minimax  approach  to  stochastic  programming.  She  showed  that 
(3.1)  attains  the  Edmundson-Madansky  bound  (and  the  Jensen  bound  if  the  objective  is 
minimized)  when  the  only  constraint  in  (3.1)  is  t/i  =  i,  i.e. ,  the  constraints  fix  the  first 
moment  of  the  probability  measure.  She  also  provided  some  properties  of  the  solution  with 
an  additional  second  moment  constraint  (vi(x)  =  z2)  for  a  specific  objective  function  /. 
To  solve  (3.1)  generally,  we  consider  a  generalized  linear  programming  procedure  (  see  [7, 
Chapter  24]). 

Generalized  Linear  Programming  Procedure  for  the  Generalized  Moment 
Problem  (GLP) 

Step  0.  Initialization.  Identify  a  set  of  L  <  M  +  1  linearly  independent  vectors  as 
in  (3.2)  that  satisfy  the  constraints  in  (3.1).  (Note  that  a  phase-one  objective  ([7])  may 
be  used  if  such  a  starting  solution  is  not  immediately  available.  For  N  =  1,  the  gaussian 
quadrature  points  may  be  used  as  mentioned  above.)  Let  u  =  L,  k  =  1,  go  to  1. 

Step  1.  Master  problem  solution.  Find  pi  >  0, . . .  ,p„  >0  such  that 


y 


£pr  =  1. 

1=1 


£u'(*i )Pi  <atj,»=  l,...,s, 

/*  i 

(3.3) 

y 

22vi(x‘)Pt  =  <*<,»  =  »  +  1,  ..,M,and 

i=i 


z  =  ^  f(xi)pi  is  maximized. 

i=i 


Let  {p\, . . . ,  pi  }  attain  the  optimum  in  (3.3),  and  let  {P* ,  wf , . . . ,  be  the  associated 
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dual  multipliers  such  that 


M 

9k  +  ^2  *fvi(xi)  =  f{xi),  if  p'  >  0,/  =  1,.  ■ .  ,u, 

>=i 

w  (3.4) 

9k  +  irkVi(xt)  >  f(xi),  if  p'  =  0,/  =  1,. . .  ,u, 

i=i 

irk  >  0,  *  =  1, . . .  ,s. 

Step  2.  Subproblem  solution.  Find  x*'+1  that  maximizes 

M 

p(x,9k  ,irk)  =  f(x)  -9k~Y,  *N(*).  (3.5) 

i=i 

If  p(x‘,+l,9k,irk)  >  0,  let  v  =  i/  +  1,  k  =  k  +  1  and  go  to  I. 

Otherwise,  stop,  {p*. . . .  ,pk)  are  the  optimal  probabilities  associated  with  in 

a  solution  to  [5]. 

The  proof  of  the  convergence  of  GLP  is  given  in  [7,  Chapter  24).  This  result  is  used 
in  [14]  to  solve  a  class  of  problems  (3.1).  The  difficulty  in  GLP  is  in  the  solution  of 
the  subproblem  (3.5),  which  generally  involves  a  noncoavex  function.  Birge  and  Wets 
[3]  describe  how  to  solve  (3.5)  with  constrained  first  and  second  moments,  if  convexity 
properties  of  p  can  be  identified.  Cipra  [6]  describes  other  methods  for  this  problem  based 
on  discretizations  and  random  selections  of  candidate  points,  .  Dula’s  [10]  gives  results 
when  /  is  sublinear  and  has  simplicial  level  sets.  Kadi  [25]  gives  the  results  for  sublinear, 
polyhedral  functions  with  known  generators. 

In  this  paper,  we  first  develop  a  separable  bounding  approximation  for  /  as  defined 
in  (13).  We  then  give  conditions  so  that  (3.1)  cam  be  solved  for  this  separable  function 
without  requiring  the  repeated  nonconvex  optimization  in  (3.5).  We  show  that  bounds  can 
be  obtauned  for  a  generad  recourse  problem  by  bounding  several  functions  in  one  dimension 
that  each  require  only  L  =  2  points  of  support  that  can  be  identified  in  one  line  seairch. 
This  result  gives  bounds  on  the  expectation  of  /  with  only  O(AT)  function  evaluations. 

4.  Separable  bounds  in  the  general  recourse  problem.  The  use  of  the  general¬ 
ized  programming  formulation  is  limited  in  multiple  dimensions  bec»'*--e  of  the  difficulty  in 
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solving  subproblem  (3.5).  These  computational  disadvantages  for  large  values  of  .V  suggest 
that  a  looser  but  more  computationally  efficient  upper  bound  on  the  value  of  (3.1)  may  be 
more  useful  than  solving  (3.1)  exactly  for  large  N. 

If  a  separable  function,  u(x)  =  i/< (x(i)),  is  available,  it  offers  an  obvious  advantage 

by  only  requiring  single  integrals.  In  this  case,  we  would  like  to  find  i/(x)  =  i/,(x(i))  > 

f{x)  where  each  «/<(*(*))  is  a  convex  function.  Methods  for  constructing  these  functions  to 
bound  the  optimal  value  of  a  linear  program  with  random  right-hand  side  are  discussed  in 
[2]  and  [4].  We  give  below  the  results  for  the  general  problem  in  (1.3). 

Lemma  4.1.  If  f  is  defined  as  in  (1.8),  then  f  is  a  convex  function  cf  x. 

Proof:  Let  yx  solve  the  optimization  problem  in  (1.3)  for  xi  and  let  y2  solve  the 
corresponding  problem  for  x2.  Consider  x  =  Axt  +  (1  -  A)x2.  In  this  case,  g{ Xyx  +  (1  - 
•%2)  <  ^<?(yi)  +  (l  — A)y(j/2)  <  Ax!+(1-A)x2.  So,  /(Ax!+(1-A)xj)  <  ?(Ay1  +  (l-A)y2)  < 
V(*  1)  +(1  -  A)/(x2),  giving  the  result.  ■ 

Let 

v(x(i))=jjf(Nx(i)ei),  (4.1) 

which  is  the  the  optimal  value  of  a  parametric  mathematical  program.  The  following 
theorem  shows  that  these  values  supply  the  separable  bound  required.  Related  bounds  are 
possible  by  defining  with  othe  rright  scalar  multiples,  /A,(x(i)e<)  (see  [36]  for  general 
properties),  where  A<  =  1.  The  proof  below  is  easily  extended  to  these  cases. 

Theorem  4.1.  The  function  v(x)  =  ^(x(i))  >  f(x),  where  f  is  defined  as  in 

(IS). 


Proof:  In  this  case,  let  y,(z(»))  solve  (1.3),  where  x(w)  =  A\s(i)e„  Then, 
<  ^1(^)[y(y<(x(i))]  <  =  x.  Next,  let  y*  solve  (1.3) 

for  x  in  the  right-hand  side  of  the  constraints.  By  feasibility  of  j  ,  /(*)  =  g(y*) 

$  liHiL  1  <  HiLi(jr)<l(yi(xi))  =  Vi(x(i))  =  u(x).  I 


This  results  demonstrates  that  a  parametric  optimization  of  (1.3)  in  »  =  1, . . . ,  N  yields 
an  upper  bound  on  /(x)  for  any  x.  Specializations  of  these  bounds  for  stochastic  linear 
programs  are  given  in  [4],  In  these  problems,  /(x)  =  miny€*.{gry  |  Ay  -  x}.  Note  that 
/  is  then  a  sublinear  function  and  that  t/(x(»))  =  f{x(i)a).  The  functions  v{  are  found  by 


solving  for  qf  =  miny6».  {qTy  |  Ay  =  ±e<}  and  letting 


if  x(i)  >  0, 
if  x(»)  <  0. 


(4.2) 
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Generalizations  of  the  stochastic  linear  program  bound  as  in  [4]  can  also  be  given  for 
the  general  bound  in  Theorem  4.1.  For  example,  we  may  apply  a  linear  transformation  T 
to  x  to  obtain  u  =  Tx.  The  constraints  become  g(y)  <  r_1(u).  A  new  bound  may  be 
found  by  letting  /*(«(«))  =  (£)  inf{9ry|T(3(y))  <  ,V( X" 1  u( «) ) }  In  linear  problems,  the 
convex  hull  of  several  of  these  bounds  obtains  good  overall  approximations  (see  [4]).  We 
note  that  adjusting  y  to  other  multipliers  A*  may  also  lead  to  better  bounds. 

To  use  any  bound  of  the  general  type  in  Theorem  3.2  to  bound  f(x)dF(x)  requires 
a  bound  on  /8  v,(x(i))dFi(xi)  or  Pi(u(«))d.FUl(u(t)),  where  Fi  is  the  marginal  distribu¬ 
tion  on  X{  and  FUi  is  the  marginal  distribution  on  u(i).  Since  function  evaluations  may 
be  expensive  (solving  (1.3))  and  distribution  information  may  be  limited  (especially  in  the 
case  of  Fu, ),  we  use  the  generalized  moment  problem  to  obtain  bounds  on  each  integral  in 
».  Generalized  linear  programming  may  solve  this  problem  but  it  can  be  inefficient.  In  the 
next  section,  we  show  that  a  large  class  of  functions  require  only  two  points  of  support  in 
the  bounding  distribution.  A  single  linesearch  can  determine  these  points  and  give  a  bound 
on  /  over  all  distributions  with  bounded  first  and  second  moments  for  the  marginals. 

5.  Two-point  support  functions.  To  ease  the  notation  in  this  section,  we  develop 
bounds  on  / i/<(z(i))dF,(z(«)  by  referring  to  /  as  a  function  on  3?  (IV  =  1).  We  then 
consider  the  moment  problem  (3.1)  with  s  =  0,  and  M  =  2  and  where  the  constraints 
correspond  to  known  first  and  second  moments.  In  other  words,  we  wish  to  find: 

U  =  suPg€„  fx  f(x)Q(dx) 

JxxQ(dx)  =  r  (5.1) 

lx  x2Q{dx)  =*(»>, 

where  V  is  the  set  of  probability  measures  on  (X,BN),  the  first  moment  of  the  true  dis¬ 
tribution  is  x,  and  the  second  moment  is  x<3).  The  problem  is  illustrated  geometrically  in 
Figure  1.  Here,  X  =  (0,  6)  and  C  =  is  the  convex  hull  of  (x,x3,/(x))  for  x  e  X.  The 
objective  in  (5.1)  is  to  find  y*  =  (x,x(3\z*)  6  C  that  maximizes  z.  A  generalization  of 
Caratheodory  s  theorem  ([39])  for  the  convex  hull  of  a  connected  set  tells  us  that  y*  can  be 
expressed  as  a  convex  combination  of  at  most  three  extreme  points  of  C,  giving  us  a  special 
case  of  Theorem  1.  Therefore,  an  optimal  solution  to  (5.1)  can  be  written,  {x*,p*},  where 
the  points  of  support,  x*  =  {*;,x;,z$}  have  probabilities,  p*  =  {p[,p;,p$}.  An  optimal 
solution  may,  however,  have  two  points  of  support.  A  function  that  has  this  property  for  a 
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given  instance  of  (5.1)  is  called  a  two-potnt  support  function.  We  give  sufficient  conditions 
below  for  a  function  to  have  this  two-point  support  property.  This  property  then  allows  a 
simplified  solution  of  (5  ' ' 


Figure  1.  The  generalized  moment  problem  in  R1. 


In  this  characterization,  we  use  a  dual  problem  to  (51),  the  semt-infinite  program 
([18])  that  appears,  for  example,  in  Chebyahev  approximation  ([35]).  For  the  one¬ 
dimensional,  two-moment  constraint  problem  considered  here,  this  dual  is  to  find  9,  xi,  t2 
such  that 


9  +  *iX  +  ir }z2  >  /(z),Vz  €  X, 


and  9  +  ir ii  +  t2z(2)  is  minimized. 


(5.2) 


Note  that  (5.2)  involves  three  variables  and  an  infinite  number  of  constraints  in  contrast 
to  the  infinite  dimensional,  finitely  constrained  primal  problem  (5.1).  Note  also  that  an 
optimal  solution  to  (5.2)  is  a  quadratic  function  that  dominates  /  and  that  has  minimum 
expectation  with  respect  to  any  probability  measure  in  V. 


The  optimality  conditions  on  a  feasible  solution  to  (5.1),  z*  =  {zj,  z2,  zj},  with  asso¬ 
ciated  probabilities,  p*  =  {pt.P3.P3},  are  that  there  exist  dual  variables,  9*.ir\,ir\,  3uch 
that 


**  +  Tix;  +  t.;(z;)s  =  /(z*)  if  P;  >  o, 


*•  +  »;*  +  *  ;zJ  > /(z),vz  e  x, 


(5.3) 


where  the  first  condition  is  complementary  slackness  condition  and  the  second  condition 
is  dual  feasibility.  A  useful  interpretation  of  these  conditions  in  terms  of  the  function  p 
defined  in  (3  5)  is  that  z*  has  a  positive  probability,  p*.  only  if  p(z;,0*,T*)  =  0  and  z* 
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maximizes  p  over  X  for  fixed  (0*,ir*)  It  is  convenient  to  let  r)  =  /(z)  -  q(x,0,ir), 

where  q(x,  0,ir)  =  &  +  nxx  +  ir2 x2.  The  following  lemmae  give  additional  properties  for  an 
optimal  solution  {z',p*}  to  (5.1).  We  assume  that  /  is  always  convex  below. 

Lemma  5.1.  If  x  =  {xi,x2,x3}  is  feasible  in  (5.1)  with  corresponding  probabilities, 
p  =  {pi,P2,P3}.  Pi  >  0  ,i  =  1,2,3,  then  there  exists  another  feasible  solution  x'  =  {z!,Z4}, 
with  p'  =  {Pi ,  P4 }  ,  where  z2  <  z4  <  z3. 

Proof:  Feasibility  of  {zi,z2,x3}  and  {pi,P2,p3}  >  0  implies  that  22<=i  P*(r<>  (x»)2)  = 
(x,  z(2)).  Consider  t(x)  such  that  z^l  — t(x))-M(x)x  =  z  and  w(x )  =  x2(l-t(x))  +  (i(x))z2. 
Note  that  t(x)  =  is  in  (0, 1)  for  z  >  z  and  tx(z)  is  strictly  increasing  in  x  for  x  >  x 
(w'(x)  =  x  —  zi).  Now  consider  p  and  q  such  that  p(x2  —  x\)  +  g(z3  —  zj)  +  zi  =  x.  Fixing 
p  in  this  equation,  we  can  find  a  corresponding  q(p)  =  .  The  weighted 

square  value  as  a  function  of  p  and  q(p)  is  u(p)  =  p(z§  —  z2)  +  q(p)(x\  -  x\)  +  x\  = 
p(x2  -  zi)(z2  -  z3)  +  (x  -  2i)(z3  +  zi)  +  zf .  Since  <(x2)  >  pj  >  0  and  z3  >  z2  >  zi, 
w(xf)  =  u(<(z2))  <  u(pa)  <  u(0)  =  «;(Z3).  So,  for  w  continuous  and  increasing,  there 
exists  z4  such  that  u>(x4)  =  u(p2)  =  x(2)  and  z2  <  z4  <  x3.  Letting  p'  ss  {(1  -  f(x4),  i(x4)} 
completes  the  proof.  ■ 

The  next  lemma  considers  /  with  a  derivative  /'  that  has  local  convexity  or  concav¬ 
ity  properties.  These  properties  form  the  basis  for  the  bounding  approach  given  in  this 
paper. 

Lemma  5.2.7/  p(£,  9,  i)  =  0  for  some  (9,ir)  feasible  in  (4-1),  x  is  in  the  interior  of 

X ,  and  f  is  convex  on  A  =  (x  -  ij,x)  for  some  7  >  0,  then  f'(t)  >  q'(t,0,ir)  for  t  £  A. 

Also,  i If  f  is  concave  on  B  =  (x,  x  +  7)  for  some  7  >  0,  then  f'(t)  <  q'{t,9,ir)  fort  £  B. 

Proof:  First,  we  assume  /'  is  convex  on  A  =  (x  —  7,  x)  for  some  7  >  0.  Let  p(  )  = 

p(-,0,x)  and  let  ?(•)  =  g(-,0,x)-  Note  that  q  is  twice  differentiable  on  X  (q'(x)  =  + 

2t2z,  7"(z)  =  2x2)  and  that,  for  /  convex,  /  is  differentiable  on  all  but  a  countable  number 
of  points  in  X.  Moreover,  since  /'  is  convex  on  A,  f  is  also  continuously  differentiable 
on  A.  Hence,  p'  exists  on  A.  We  can  let  p(_(z)  =  lim«ioP'(*  -  <)•  We  can  also  define 
p'+(x)  =  lim^op'C*  +  t)  when  f  is  concave  on  B.  Note  that  p±(z)  =  /±(z)  -  q'{x). 
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If  p(x )  =  0  for  feasible  (0,  t)  in  (5.2),  then  x  maximizes  p  over  X.  Therefore,  0  € 
co\p'_(x), pf+{x)\.  By  convexity  of  /,  f'+(x)  >  f'_{x),  p'+{x)  >  p'_(x),  and,  thus,  p'~{x )  <  0. 
Suppose  p'~(x)  <  0,  then  p(x  - 1)  +  p' {x  -  s)(t)  =  p(i)  for  all  t  €  (0,rj)  and  some  0  <  s  <  t. 
By  p'  continuous  in  this  interval,  there  exists  c  such  that  p'(x  —  s)  <  0  for  all  0  <  s  <  e. 
For  0  <  t  <  £,  we  would  have  p(x  —t)>  p(x),  contradicting  the  maximality  of  x.  Hence, 
p'Jx)  =  0. 

By  applying  the  mean  value  theorem  to  p  and  p',  we  also  have  that  p(x  —  t)  =  p(x)  + 
p'(x  -  s)(-t)  =  p(x)  +  (-t)(-s)(y(r)  -  q"(r)),  where  0  <  r  <  s  <  t  and  y(r)  e  [(/')-(*  “ 
r),  (/')+(*  -  r)].  Letting  r  vary  with  t  as  r(t)  and  noting  that  lim«-. o  y(r(t))  =  (/')'_  (i) 
and  p(x  —  t)  —  p(x)  <  0  for  t  close  to  0,  we  obtain  0  >  {f')L(x)  —  q"{x).  Now,  consider 
p'(x  -  t)  =  f'(x  -  t)  -  q'{x  -  t)  =  f'(x)  -  q'(x)  +  (-*)(y(x  -  s)  -  q"(x  -  s))  where 
y(x  -  s)  €  [(/')-(*  _  a)>(/,)+(*  —  <)]•  By  /'  convex  on  A  and  q"(x  —  s)  =  g"(x)  =  for 
any  s,  y(x  -  s)  -  ^"(x  -  s)  <  (/')'_(*)  -  ?"(x)  <  0.  So,  /'(x  -  t)  -  q'(x  -  t)  >  0  for  all 
t  €  (0,  rj).  A  similar  argument  holds  if  /  is  concave  on  23.  ■ 

The  previous  lemma  considers  local  convexity  properties  of  /'  when  it  exists.  The 
following  results  refer  to  functions  with  derivatives  that  are  convex  and  then  concave. 

Lemma  5.3.  Let  g(x)  =  h(x)  —  c(x)  be  a  function  such  that  h(x)  is  increasing  and 
upper  semi-continuous  on  3?,  h(x)  is  convex  on  (— oo,  y)  and  concave  on  (y,  oo),  and  c(x) 
is  an  affine  function  on  S.  Then  there  exists  a  partition  of  (—00,00)  into  subintervals, 
h  —  (— h  —  («i.«*j),  h  =  (aji<*3)<  U  —  [03,  +00),  —00  <  ai  <  a2  <  03  <  00,  such 
that  g(x)  >  0  for  all  x  &  I^U  I3  and  g(x)  <  0  for  all  xg/jU  /4.  (When  any  of  alt  a2,  03 
—  ±00,  then  we  interpret  the  interval  as  open  at  the  corresponding  value  of  ±00.) 

Proof:  First  note  that  g  is  continuous  on  (— 00,  y)  and  (y,oo).  By  convexity  and  for 
h  increasing  at  y,  Sq  —  {x|y(x)  <  0,  x  <  y}  =  [a,  6)  (or  0)  for  some  -00  <  a  <  b  <  y 
(when  a  =  —00  and  when  6  =  y,  the  interval  is  open  at  a  or  6  respectively).  Similarly,  by 
concavity  on  (y,oo),  Sq  =  (x|y(x)  >  0,x  >  y}  =  [c,d]  (or  0)  for  some  00  >  d  >  c  >  y 
(where  we  have  an  open  interval  if  d  =  00).  Note  that  if  6  <  y,  then  y(x)  >  0  on  [6,y], 
so  c  =  y.  From  this  observation,  if  Sq  and  Sq  are  not  empty,  then  g  is  nonnegative  on 
(-00,  a]  and  either  (i,  d\  or  (c,  dj  by  continuity  at  a  and  b  if  b  <  y.  If  5^  =  0,  then  S£  ^  0, 
and  g  is  nonnegative  on  (—00,  d],  since  g  is  increasing  at  y.  If  Sq  =  0,  then  g  is  nonegative 
on  (-00,  a].  Thus,  let  a!  =  a  if  Sq  ^  0,  ai  =  d  if  Sq  =  0,  a2  =  5  if  Sq  ^0  and  b  <  y, 
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d2  =  c  if  Sq  ^  0  and  b  =  y,  aj  =  oo  if  Sq  =  0,  and  03  =  d  if  Sq  £  0,  Sq  ^  0.  <13  =  00  if 
Sq  =  0  or  Sq"  =  0.  This  yields  the  regions  in  the  lemma.  ■ 

The  next  lemma  considers  the  case  where  g  =  p'  is  constant  on  an  interval.  In  the 
following,  we  use  the  notation  X  =  [a,  6]  for  convenience.  It  is  assumed  that  this  also 
includes  the  cases  X  =  (—00,6],  X  =  [a,  +00),  and  X  =  (-00, +00)  unless  explicitly  stated 
otherwise. 

Lemma  5.4.  If  f  is  convex  on  X  =  [a,  6]  with  derivative  f  defined  as  a  convex 
function  on  [a,c)  and  as  a  concave  function  on  (c,  6]  for  a  <  c  <  b  and  if  p(z,0,x)  =  0 
for  some  (9,  it)  feasible  in  (4-1)  and  for  all  x  £  (x  —  c,x  +  e)  for  some  x  £  X  and  e  >  0, 
then  there  exists  an  interval  D  D  (z  —  e,  x  +  e)  such  that  p(x,9,ir)  =  0  for  all  x  £  D  and 
p(x,  fr)  <  0  for  all  x  £  the  closure  of  D. 

Proof:  Let  D  =  (d,  e)  be  the  largest  open  interval  including  (x  —  c,i  +  e)  such  that 
p(x)  =  0  for  all  x  £  D.  First,  we  show  that  c  £  [d,e].  If  not,  then  suppose  d  >  c.  In  this 
case,  /'  is  concave  on  (c,e].  For  x  £  D,  p(x)  =  0,  so  /'(z)  =  ?'(z)  and  f"(x)  =  q"(x). 
From  Lemma  5.1,  q'{x)  >  /'(z)  on  (c,e),  and  /'(z)  -  q'(x)  <  0  on  (c,d)  by  concavity. 
Thus,  p(x)  =  p(d)  <  p(x)  for  any  z  €  (c,  d),  which  contradicts  the  maximality  of  z.  Hence, 
d  <  c.  Symmetrically,  e  >  c. 

By  Lemma  5.2  and  /'* s  implied  semicontinuity  at  the  endpoints,  pf  >  0  on  [a,c)  and 
p'  <  0  on  (c,  6].  By  convexity  of  f  on  [o,c),  the  set  {zj/'(z)  <  q'{x),a  <  z  <  c}  =  [d,c), 
if  d  <  a.  Hence,  p'(z)  >  0  on  (a,d).  Similarly,  p'(z)  <  0  on  (e,6J.  Thus,  p(z)  <  0  on  [a,d) 
and  (e,6j.  ■ 

The  convex-concave  property  is  now  used  to  derive  our  main  result  about  two-point 
support  functions. 

Theorem  5.1.  If  f  is  convex  with  derivative  f  defined  as  a  convex  function  on  (a,c) 
and  as  a  concave  function  on  ( c,b )  for  X  —  [a,  6]  and  a  <  c  <  b,  then  there  exists  an  opti¬ 
mal  solution  to  (4.I)  with  at  most  two  support  points,  {zi.zj},  with  positive  probabilities, 
{Pi.Pj}- 

Proof:  Let  {^,ir}  be  an  optimal  solution  to  (5.1).  First,  assume  that  there  does  not 
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exist  e  >  0,  x  €  (a,  b)  such  that  p(xj,x)  -  0  for  ail  x  €  (i  -  e,  x  +  c).  By  Lemmas 
5.1  and  5.3,  the  only  isolated  points  where  p  could  be  0  and  maximized  are  ai  and  03  if 
[a,  b]  3  Ii  u  I3.  If  [a,  6]  2  /j,  then  a  can  replace  a\  and  if  [a,  6]  2  h,  then  b  can  replace  03, 
but,  in  either  case,  at  most  two  points  meet  the  conditions  for  optimality. 

If  there  exists  e  >  0,  x  €  (a, b)  such  that  p(x,  9,  k)  =  0  for  all  x  €  (x  -  c,  x  +  c),  then 
Lemma  5.4  implies  that  any  optimal  solution  {xi.xj.zs}  must  be  in  the  closure  of  D  and 
that  p(  1)  =  0  for  all  x  €  D.  By  Lemma  5.2,  we  can  select  in  (xj,i3)  such  that  there 
exists  {pi,?*}  so  that  {xi, X4.p1.p4}  is  feasible  in  (5.1).  The  optimality  conditions  still 
hold  for  p(x4)  =  0.  Hence,  {x1.X4.p1.p4}  is  optimal  in  (5.1).i 

A  corollary  of  Theorem  5.1  is  that  any  function  /  that  has  a  convex  or  concave  derivar 
tive  has  the  two-point  support  property.  The  class  of  functions  that  meets  the  criteria  of 
Theorem  5.1  contains  many  useful  examples.  Some  of  these  functions  are  given  below: 

1 .  Polynomials  defined  over  ranges  with  at  most  one  third  derivative  sign  change. 

2.  Exponential  functions  of  the  form,  co«4,,.co  >  0. 

3.  Logarithmic  functions  of  the  form,  /oy*(cx),  for  any  k  >  0. 

4.  Certain  hyperbolic  functions  such  as  sinh(cx),c,x  >  0,  cosh(cx). 

5.  Certain  trigonometric  and  inverse  trigonometric  functions  such  as  tan-1(cx),c,  x  >  0. 

In  fact,  Theorem  5.1  can  be  applied  to  provide  an  upper  bound  on  the  expectation 
of  any  convex  function  with  known  third  derivative  when  the  distribution  function  has  a 
known  third  moment,  x^3^.  Suppose  a  >  0  (if  not,  then  this  argument  can  be  applied  on 
[a,  0]  and  [0,4]),  then  let  g(x)  =  ax 3  +  /(x).  The  function  g  is  still  convex  on  [0,5)  for 
a  >  0.  By  defining  a  >  (—1/6)  min(0,  inf,e(,,»]  /'"(x)),  g“  is  convex  on  [0,6],  and  an  upper 
bound,  UB(g),  on  E,(x)  has  a  two-point  support.  The  expectation  of  /  is  then  bounded 
by 

Ef(x)  <  UB(g)  -  or<3).  (5.4) 

The  conditions  in  Theorem  2  are  only  sufficient  for  a  two-point  support  function.  They 
are  not  necessary.  The  following  function,  for  example,  has  an  optimal  two-point  support 


14 


at  i*  =  {1/3, 1}  for  any  corresponding  feasible  p\  and  p*  when  X  =  [0, 1]. 


/(*) 


'  6/5  -  4x  +  5x2  if  0  <  x  <  .2, 

2x  +  1  if  .2  <  x  <  .4, 

-(2/5)x  -  8x2  +  10x3  if  .4  <  x  <  .6, 

.  -4x  +  4x2  if  .6  <  x  <  1. 


(5.5) 


The  function  defined  in  (5.5)  does  not,  however,  meet  the  conditions  of  Theorem  51.  This 
and  other  two-point  support  functions  can  always  be  constructed  by  fixing  9,  jti  ,  tt?  and 
considering  any  function  /(x)  <  <j(x,0,t)  such  that  f(x\)  =  q(x\,9,  ir),  f(xi)  =  q(x 
Axi  +  (1  -  A)x2  =  x,  and  Axf  +  (1  -  A)x§  =  x^2)  for  some  0  <  A  <  1.  Any  convex  / 
satisfying  these  conditions  corresponds  to  optimal  in  (5.2).  No  other  conditions 

on  the  function  are  necessary. 

Note  also  that  not  all  functions  are  two-point  support  functions  (although  bounds 
using  (5.4)  are  available).  A  function  requiring  three  support  points,  for  example,  is  /(x)  = 
(l/2)-^/(l/4)  —  (x  -  (1/2))3.  This  function  and  its  optimal  dominating  quadratic  function 
are  illustrated  in  Figure  2. 


Figure  2.  A  function  requiring  three  support  points. 


Given  that  a  function  is  a  two-point  support  function,  the  points  {xi ,  xj}  can  be  found 
using  a  line  search  to  find  a  maximum.  For  example,  if  some  candidate  zi  <  x  is  given, 
then  a  feasible  corresponding  x?  is 


*2 


Z<2)  -  XXI 
X-Zi 


(5.6) 


where  p\  =  (xj  -  x)/(xj  -  xi)  and  p?  =  1  —  p\.  Note  that  the  problem  is  obviously  not 
feasible  if  (xi,  xj)  jf  x.  The  solution  of  (5.1)  then  reduces  to  maximizing  : 


7(*i)  =Pi(*i)/(*i)  +  Pa(*i)/(*j(*i))  subject  to  z\  €  [a,*).  (5.7) 


A  line  search  to  find  the  maximum  in  (4.7)  can  be  performed  efficiently  using,  for 
example,  Lemarechai  and  Mifflin's  procedure  in  [30]  if  y  G  C3  or  Mifflin  and  Strodiot’s  [32] 
method  without  derivatives.  Table  1  gives  the  values  (under  “2-M")  that  were  obtained  by 
this  procedure  for  three  two-point  support  functions  with  distributions  on  [0, 1].  Figures  3- 
5  illustrate  that  the  optimal  points,  {z{,zj},  may  be  at  either  endpoint  or  interior  to  [0,  l]. 
The  cable  gives  the  Jensen  lower  bound  and  the  expectation  for  a  random  variable  with 
beta  distribution  (under  “Beta”)  with  the  given  first  and  second  momenta  for  comparison. 
The  Edmundson-Madansky  upper  bound  (“E-M”)  is  also  provided.  The  “S-L”  value 
(for  “semi-linear  bound”)  given  in  Table  1  corresponds  to  bounding  /  with  a  semt-ltnear 
function  that  has  the  form: 


q~(c-x) 
q+(x  -  c) 


if  x  <  c, 
if  x  >  c, 


where  q+  +  q~  >  0.  This  type  of  function  is  useful  because  a  line  search  is  not  necessary 
for  solving  (5.7).  The  support  points  can  be  calculated  analytically  by  observing  that  the 
conditions  of  Theorem  2  are  met  and  by  finding  the  optimal  x\  in  (5.7)  as  a  function  of  c. 
The  results  depend  on  the  interval,  [o,  6].  If  [a,  6]  =  [0, 1],  then  consider  the  nonintersecting 
intervals,  A  =  (0,  x^/{2x)),  B  =  [z<3V(2z),(l-z<J>)/(2(l-z))],  andC  =  ((l-z<3>)/(2(l- 
z)),  1).  The  points  of  support  for  a  semi-linear,  convex  function  defined  on  [0, 1]  are 


f{0,z<J>/z}  ifceA, 

{*!.*;}*  {  {c-d,c  +  d}  ifc  €B,  (5.8) 

[{(z-zW)/(l-z),l}  if  c  €  C, 


where  d  =  Vc2  —  2ez  +  z(J5.  This  result  can  be  obviously  extended  to  all  finite  intervals. 
It  results  from  using  (5.6)  and  differentiating  y  with  respect  to  zj  in  (5.7). 

Infinite  intervals  can  also  be  solved  analytically  for  semi-linear,  convex  functions.  For 
X  =  [0,  oo) ,  the  results  are  as  in  (5.8)  with  B  =  [z(J)/(2i)>  oc)  and  C  =  0.  For  the  interval 
(-00,00),  the  pointa  of  support  are  those  for  interval  B  in  (5.8).  We  note  that  special  cases 
for  these  supports  of  semi-linear,  convex  functions  were  considered  in  [11],  [22],  and  [38]. 

Semi-linear,  convex  functions  are  common  in  decision  problems  to  represent  penalties 
for  being  above  or  below  a  preferred  value,  c.  They  can  also  be  used,  however,  to  provide 
bounds  for  other  convex  functions  when  only  the  first  and  second  moments  of  the  distri- 
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Table  1.  Bounding  values 


Function 

f , 

Beta 

2-M 

S-L 

E-M  i 

0.500,  0.333 

■DKTjQH 

0.622 

X3 

0.833,  0.714 

0.625 

| 

1 

KffgK: 

sin(  ir(x  +  1)) 

+  1 

0.500,  0.333 

0.363 

0.384 

0.577 

1 

bution  function  ate  known.  Results  from  using  these  functions  in  problems  with  linear 
recourse  appear  in  [2,3,40]. 

We  conclude  with  an  example  for  bounding  a  nonlinear  recourse  function  with  the 
form  in  (1.3).  We  suppoee  in  this  case  that 

,  "  l)2  +(ya-2)J 

/(*(1).*(2))  =  {  s.  t.  y?  +y|  - 1  <x(l)  (5.9) 

(Vi  -  l)a  +v\  -  1  <  *(2). 

This  problem  may  correspond  to  determining  a  performance  characteristic  of  a  part  that 
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0  0.4  ai  04  i 

s 

Figure  5.  Optimal  bounding  function  for  ain(*(x  +  1))  +  1. 

is  machined  by  two  circular  motions  centered  at  (0,0)  and  (1,0)  respectively.  Here,  the 
performance  characteristic  is  proportional  to  the  distance  from  the  finished  part  to  another 
object  at  (2, 1).  The  square  of  the  radii  of  the  tool  motions  is  x(i)  +  1  where  x(«)  is  a 
nonnegative  random  variable  associated  with  the  machines’  precision.  Figure  6  illustrates 
the  solutions  for  xft)  =  0  and  x(i)  =  1  for  i  =  1,2. 


Figure  6.  Nearest  points  to  (2, 1). 


We  suppose  that  it  is  known  that  the  x(t)  are  nonnegative,  that  x(i)  =  1  and  the 
x(2)(i)  =  1.25.  In  this  case,  we  would  like  an  upper  bound  on  the  expected  performance 
E,{x).  We  construct  a  bound  by  first  finding  Vi{x(i))  as  in  (4.1).  In  this  case,  we  solve 
(5  9)  with  right-hand  sides  mx(i)e<  to  obtain 


•'iWl)) 


1  f  agt^al  +  ( H±4rt -  2)»  ifx(l)<0.5 

2  1 1.0  if  x(l)  >  0.5, 


**(*(2)) 


1  /  1  +  _  2)>  ifx(2)<0.5-(^) 

)’  ifx(2)->0,-(5). 
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NuUxU))  Nu2  (x  (2)  ) 


Figure  7.  The  bounding  functions  v\  and  t/j. 

These  functions  are  illustrated  in  Figure  7.  Their  third  derivatives  are  nonpositive  so  the 
first  derivative  of  each  i/{  is  concave,  meeting  the  conditions  for  two-point  support.  The 
functions  7  for  x(l)  and  *(2)  are  given  in  Figure  8.  Notice  that  the  maximum  occurs  at  0 
in  each  case.  The  resulting  upper  bound  on  Ef(x)  is  then  (1.107  +  1.529)/2  =  1.318.  We 
can  compare  this  to  the  lower  bound  of  f{x)  —  0.822  to  bound  the  expected  performance. 
In  comparing  to  other  bounds,  the  best  available  bound  knowing  only  the  mean  and  the 
nonnegative  range  is  1.529,  the  value  at  (0, 0),  since  a  distribution  can  meet  the  range  and 
mean  conditions  with  a  probability  p  mass  at  (0,0),  probability  (l-p)g  at  (i(l),  0)/g(l-p), 
and  probability  (1  -  p)(l  -  q)  at  (0,x(2))/(l  -  p)(l  -  ?),  where  0  <  q  <  1  and  p  may  be 
become  arbitrarily  close  to  1. 


Sanaa 


Figure  8.  The  7  functions  for  x(l)  and  x(2). 


6.  Conclusions.  This  paper  describes  a  bound  on  the  general  recourse  problem  and 
a  resulting  bound  on  the  expectation  of  convex  functions  when  only  limited  distributional 
information  is  available.  Given  the  difficulties  in  estimating  random  phenomenon,  limited 
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information  in  terms  of  bounds  on  the  mean  and  second  moments  of  distributions  is  a  gen¬ 
eral  practical  situation.  The  bounds  provided  in  this  paper  allow  for  efficient  computation. 
We  note  that  these  procedures  can  be  extended  to  lower  bounds  on  the  expectation  of 
concave  functions  obviously.  Since  the  Jensen  inequality  is  the  solution  of  the  generalized 
moment  problem  to  minimize  the  expectation  of  a  convex  function  subject  to  a  first  mo¬ 
ment  equality  constraint  and  an  upper  bound  on  the  second  moment  constraint,  upper  and 
lower  bounds  eue  computable  on  the  expectation  of  general  functions  that  can  be  expressed 
as  linear  combinations  of  convex  and  concave  functions.  Given  this  extension,  the  use  of 
separable  convex  functions  and  the  two-point  support  bounds  apply  to  a  wide  range  of 
problems. 
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